Papers with communication system
CLeLfPC: a Large Open Multi-Speaker Corpus of French Cued Speech (2022.lrec-1)
Copied to clipboard
| Challenge: | Cued Speech is a visual communication system developed for deaf people to complement speechreading at the phonetic level with hands. |
| Approach: | They describe a visual communication mode that uses handshapes in different placements near the face and mouth movements to make the phonemes of spoken language look different from each other. |
| Outcome: | The proposed system is based on 4 hours of audio and video recordings of 23 participants. |
Automatically Estimating Textual and Phonemic Complexity for Cued Speech: How to See the Sounds from French Texts (2024.lrec-main)
Copied to clipboard
| Challenge: | Cued Speech (CS) is a visual communication system developed for people with hearing loss to complement speech reading at the phonetic level. |
| Approach: | They propose a method to phonemize written corpora so that each word is aligned with the corresponding CS key(s) this method is part of a wider project aimed at creating an augmented reality system displaying a virtual coding hand where the user will be able to choose a text upon its complexity for cueing. |
| Outcome: | The proposed method is part of a wider project aimed at creating an augmented reality system displaying a virtual coding hand where the user can choose a text upon its complexity for cueing. |
Context Shapes Emergent Communication about Concepts at Different Levels of Abstraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Concept-level reference game allows speakers to communicate concepts at different levels of abstraction and in different contexts. |
| Approach: | They use a symbolic dataset that disentangles concept type and context to study the influence of these factors on the emerging language. |
| Outcome: | The proposed model disentangles concept type and context to study the communication of concepts at different levels of abstraction and in different contexts. |